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@ Apparatus and method for obtaining surface profilometry and three dimensional surface contours. 



@ Phase measurements of deformed grating images are used 
in performing improved optical profilometry. In one embodiment, 
an incident beam of light having a sinusoidally varying intensity 
pattern is directed (110) at the object (1 50) and the phase of the 
sinusoidal intensity pattern of the incident beam is modulated. A 
deformed grating image of the object for a number of different 
modulated phases of the incident beam is received at a detector 
(120). Then, for points on the surface of the object, the height at 
each point is determined with respect to a reference plane, each 
height determination including the step of combining the image 
intensity values at a detector position corresponding to a respec- 
tive point of the object. In another embodiment, line profiles are 
obtained at a series of rotational increments of a body. A full 360 
degree surface profile, or a portion thereof, can then be gener- 
ated. 
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APPARATUS AND METHOD FOR OBTAINING SURFACE 
PROFILOMETRY AND THREE DIMENSIONAL SURFACE CONTOURS 



This invention relates to the determination of the 
surface height of three-dimensional objects and, more 
particularly, to an improved apparatus and method of surface 
prof ilometry . 

This invention also relates to the determination of the 
surface contours of objects and, more particularly, to an 
improved apparatus and method for determining three 
dimensional surface profiles of objects, including 360 
degree renditions thereof. 

Surface profile measurement by non-contact optical 
methods has been extensively studied because of its 
importance in fields such as automated manufacturing, 
component quality control, medicine, robotics, and solid 
modeling applications. In most of these methods a known 
periodic pattern, such as a grating, is projected on the 
surface to be measured and the image of the grating, 
deformed by the surface, is analyzed to determine the 
profile. "Demodulation" of the deformed grating by means of 
a matched reference grating results in the well known Moire 
fringe patterns, which are easily interpretable as surface 
contours by a human observer, but, are somewhat more 
complicated for computer analysis . (See, for example, D.M. 
Meadows, W.O. Johnson and J.B. Allen, Appl . Opt. 9, 942 
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(1970); H. Takasaki, Appl. Opt. 9, 1467 (1970); P. Benoit, 
E. Mathieu, J. Horraiere and A. Thomas, Nouv. Rev. Opt. 6, 67 
(1975); T. Yatagai, M. Idesawa and S. Saito, Proc . Soc . 
Photo-Opt. Instrum. Eng. 361, 81 (1982) ). Improvements to 
the Moire method, aimed at increasing accuracy and at 
automating the measurements have been based, for example, on 
phase modulation. (See G. Indebetouw, Appl . Opt. 17, 2930 
(1978), D.T. Moore and B.E. Truax, Appl. Opt. 18, 91 (1979). 

An alternative approach to Moire is by an analysis of 
the deformed grating itself without the use of a physical or 
virtual reference grating. Direct methods based on 
geometrical analysis of the deformed grating requiring 
fringe peak determination are computationally complex, slow, 
and result in low accuracy. Another direct method, based on 
the use of a Fast Fourier Transform analysis of the deformed 
grating, has been demonstrated to be more suitable for 
automated profilometry (see, for example, M. Takeda and K. 
Mutoh, Appl. Opt. 22, 3977 (1983) ). Limitations on 
measurement of steep object slopes and step discontinuities, 
the need for high resolution imaging systems and the need 
for powerful computing capability are some of the 
disadvantages of the Fast Fourier Transform method. 

It is among the objects of the invention to provide an 
improved method and apparatus for surface profilometry. 
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An approach to obtaining a complete 360 degree view of 
a general three-dimensional object, which has been the 
subject of intense activity, especially in computer vision 
research, is the reconstruction of three-dimensional shapes 
from several objects views, as seen from different points of 
observation. It generally involves the use of elaborate 
computer algorithms to 'match' these views in order to unify 
the images to determine the complete object shape. [See, 
for example, B. Bhanu, "Representation and Shape Matching of 
3-D Objects", IEEE Trans. Anal. Machine Intell. PAMI-6, 340 
(1984).] Such a digital image processing approach is 
computation intensive and generally offers limited accuracy. 

Another approach involves the use of the shadow moire 
method in conjunction with a periphery camera. It tends to 
be mechanically cumbersome and to require tedious processing 
of fringe, patterns recorded on film. [See, for example, 
C.G. Saunders, "Replication from 360-degree Moire Sensing", 
in 'Moire Topography and Spinal Deformity', M.S. Moreland, 
et al., EDS., Pergamon Press, New York, (1981), p. 76.] 

It is among the further objects of the present 
invention to provide a technique which is applicable to 
efficient and automatic obtainment. of a three dimensional 
surface profile of an object, including the capability of 
obtaining a complete 360 degree surface profile. 
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SUMMARY OF THE INVENTION 

A form of the invention employs, inter alia, phase 
measuring techniques that have been used in classical 
interferometry, but are particularly advantageous for use in 
deformed grating prof ilometry . when a sinusoidal intensity 
distribution is projected on a three dimensional diffuse 
surface, the mathematical representation of the deformed 
grating image intensity distribution is similar to that 
encountered in conventional optical interferometry. The 
surface height distribution can be translated to a phase 
distribution, and the accuracy which is characteristic of 
phase modulation interferometry, can be used to advantage 
here. CSee, for example, J.H. Bruning, D.R. Herriott, J.E. 
Gallagher, D.P. Rosenfeld, A. D. White and D.J. Brangaccio. 
Appl. opt. 13, 2693 (1974); J.c. Wyant, Appl . Opt. 14, 2622 
(197S) for background.] Further, by using several phase 
modulated frames of deformed grating image data, a high 
degree of precision in the phase measurement can be 
achieved. By analogy with phase-measuring interferometry, 
where phase values can be measured with a resolution of 
1/1000 of a fringe period (versus 1/30 for conventional 
single frame interferometry), surface profile measurements 
with less than 10 micron resolution are possible by the use 
of an optical system with a projected grating pitch in the 
millimeter range. 
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Among the advantages of the invention are the 
following: relatively simple Qptical hardware; relativQly 
low frequency grating and low density detector array; full 
frame data capture and relatively simple processing. 

m accordance with the improvements of a further form 
of the present invention, a complete 360 degree, or portion 
thereof, surface contour of an object can be obtained 
efficiently and with relatively inexpensive equipment, and 
without undue processing complexity, undue data acquisition 
and storage requirements, etc. 

in accordance with an embodiment of the method of this 
form of the invention, there is provided a technique for 
determining a three-dimensional surface profile of an 
object. An incident beam of light is directed at the 
object, the beam having a sinusoidally varying intensity 
pattern. The phase of the sinusoidal intensity pattern is 
modulated, such as by moving of a gating used to obtain the 
sinusoidally varying intensity pattern. A deformed grating 
image of a line profile of the object is detected. 
Preferably at a linear detector; i.e., a detector having 
individual detector elements arranged in a line. For points 
on the line profile of the object, the distance of each such 
Point from a reference line is then determined, each such 
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In accordance with an embodiment of the method of the 
invention, a technique is set forth for determining the 
surface profile of a three-dimensional object. An incident 
beam of light, having a sinusoidally varying intensity 
pattern, is directed at the object. The phase of the 
sinusoidal pattern of the incident beam is modulated. A 
deformed grating image of the object is received, at a 
detector array, for a number of different modulated phases 
of the input beam. The height of each point (i.e., 
elemental region) of the surface of the object is then 
determined with respect to a reference plane, each such 
height determination including the combining of the image 
intensity values at a detector position corresponding to a 
respective point of the object. 

In the disclosed embodiments of the invention, the 
combined intensity values, for the object and for the 
reference plane, are used to obtain an object phase for each 
point and a reference phase for each point. In one 
embodiment the difference between the object and reference 
phases for corresponding points is used in the height 
determination. In another embodiment, a phase mapping as 
between object and reference phases is used in the height 
determination . 
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distance determination including the step of combining 
intensity values of the received image at the different 
modulated phases to obtain an object phase for each point. 
In this manner, the coordinate locations of the points on a 
line profile of the object can be determined. [In the 
preferred embodiment, deformed grating images of the 
reference line are also obtained and used to obtain a 
reference phase for each point on the reference line, the 
reference phases then being used in the distance 
determinations of the object line profile coordinates with 
respect to the reference line.] The object is then rotated 
by a rotational increment, and the above steps are repeated 
to obtain the distances from the reference line of the 
object points on the next line profile. This procedure can 
then be repeated, as the object is rotated by further 
rotational increments, to obtain the distance information 
(and coordinate information, if desired) for line profiles 
covering a full 360 degrees of rotation of the object. As 
will be described, the data can be obtained in various 
procedural orders. 

The technique hereof has several advantages compared 
with other methods of 360-degree shape reconstruction. in 
addition the the relative simplicity in setup and 
computation, the invention does not involve any complex 
view-matching operations and is characterized by high 
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measuring accuracy. The invention also lends itself more 
readily to complete automation without the need for major 
host system support. The main trade-off i 8 a relatively low 
data acquisition rate, so the invention is preferably used 
for obtaining surface contours of stationary, rigid objects. 

Further features and advantages of the invention will 
become more readily apparent from the following detailed 
description when taken in conjunction with the accompanying 
drawings . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram, partially in schematic form, 
of an apparatus in accordance with a form of the invention, 
and which can be used to practice the method of the 
invention. 

Fig. 2 is a schematic diagram of an embodiment of a 
projection and phase shifting system as used in the Fig. 1 
embodiment . 

Fig. 3 illustrates the optical geometry of a form of 
the Fig. 1 embodiment, as used for an analysis of operation. 

Fig. 4, which includes Figs. 4A and 4B placed one below 
another, is a flow diagram of a routine for programming the 
processor of the Fig. 1 embodiment. 

Fig. 5 shows a deformed grating inter ferogram of a 
three dimensional object as seen by the detector array of 
the Fig. 1 embodiment. 

Fig. 6 is a surface profile block of the three 
dimensional object of Fig. 4. 

Fig. 7 is a schematic diagram which illustrates a 
further embodiment and is used in describing the optical 
geometry thereof. 

Fig. 8, which includes Figs. 8A and 8B placed one below 
another, is a flow diagram of a routine for programming the 
processor of the Fig. 7 embodiment. 
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Pig. 9 shows the result of a calibration experiment, 
using a technique in accordance with the embodiment of Fig. 



7. 



Fig. 10 shows a mannequin face with a projected 
sinusoidal grating of 15 mm period. 

Fig. 11 is a perspective profile plot of the mannequin 
face with respect to a reference plane. 

Pig. 12 is a flow diagram of a routine that is used in 
conjunction with the routines of Figs. 4 and 8. 

Fig. 13 illustrates the geometry used for analysis of 
operation of a form of the invention, and shows elements of 
the invention. 

Pig. 14 is a block diagram, partially in schematic 
form, of an apparatus in accordance with an embodiment of a 
further form of the invention, and which can be used to 
practice the method of the invention. 

Fig. 15 is a flow diagram of a routine for programming 
the processor of the Fig. 14 embodiment to obtain object and 
reference data. 

Fig. 16 is a flow diagram of a routine for programming 
the processor of the Fig. 14 embodiment to obtain object and 
reference phases to be used in profile distance 
determination . 

Fig. 17 is a block diagram of a routine for programming 
the processor of the Fig. 14 embodiment to obtain distances 
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and coordinates on the surface profile. 

Fig. 18 shows line profiles obtained using an 
experimental form of the invention. 

Fig. 19 shows the information from Fig. 18, presented 
in a different direction. 

Figs. 20, 21, 22 and 23 illustrate three dimensional 
plots as obtained using an experimental form of the 
invention. 
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Referring to Fig. 1, there ia shown a blQck ^ 
an apparatus in accordance with a first form of the 
invention and which can be used to practice the method of 
the invention. A sinusoidal grating projection system and 
Phase shifter 110 is provided, and projects an optical beam 
at a three dimensional object 150. The reflected beam is 
received by a detector array system 120 which, in the 
illustrated embodiment detects frames of data which are 
stored in buffer 140 and processed by processor 150. The 
processor 150 may be. for example, any suitable analog or 
digital computer, processor, or microprocessor and 
conventional associated memory and peripherals, programmed 
consistent with the teachings hereof. In the experiments 
described hereinbelow, a model LSI 11/23. made by Digital 
Equipment Corp.. was utilized. The processed information 
can be displayed on a display device 160. 

A sinusoidal intensity distribution can be projected on 
the surface to be profiled, e.g. by generating an 
interference pattern between two coherent plane wavefronts 
or by projecting an image of a grating with sinusoidal 
transmission function distribution illuminated by an 

incoherent light source win •>•■,-, 

y «- source. Pig. 2 illustrates an embodiment 

of the projection system and phase shifter 110 (of Pig. i). 
which comprises a laser illuminated shearing polarization ' 
interferometer. The linearly polarized output beam from the 
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laser 111 is spatially filtered by filter 112, which 
includes lens 113 and pinhole 114, and then sheared by a 
Wollaston prism W. The phase modulator includes a 
combination of a quarter wave plate Q and a rotatable 
polarized P. By rotating the polarizer, the sinusoidal 
intensity distribution of the interference pattern can be 
modulated. A 180° rotation of the polarizer corresponds to 
a 27T phase modulation and this permits precise phase shifts. 
It will be understood that other types of phase shifters, 
for example polarization dependent phase shifters such as 
electro-optic modulators, may also be used in this system. 
The fringe period can also be easily changed by an axial 
translation of the Wollaston prism W. A collimating lens L 
is used to conserve light and simplify the optical geometry. 

Before further describing operation of the apparatus of 
this embodiment, consider the diagram of Fig. 3 in which the 
height h(x,y) of object 150 is to be measured relative to 
the indicated reference plane. The projected sinusoidal 
interferometric pattern has a period p Q as seen on the 
reference plane, and the intensity that it produces at a 
point, such as c on the reference plane, is 



I =* a(x,y) + b(x,y)cos ( 2nOC/p n ) 



(1) 



where a(x,y) is the background or DC Light level, b(x,y) is 
the fringe contrast and O, the intersection of the imaging 
optical axis with the reference plane is assumed, for 
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convenience, to coincide with an intensity maxima of the 
projected pattern. The argument <f) R = 2H OC/p of the cosine 
function in Eq. (1) is defined as the "phase** at C and it 
effectively measures the geometric distance OC, if O is 
taken at the reference point where the phase is zero, ^ 
is one of the detectors in the array, located at the image 
plane and is used to measure the intensity at C on the 
reference plane and at D on the object. An imaging lens 
120a, of the detection system 120, is shown in the Pig. 3 
diagram. The intensity observed at D is the same as that 
which would have been observed at A on the reference plane, 
modified by the object reflectivity r(x,y), that is 

*D = r(x,y) C a(x,y) + b(x,y)cos ( 2K OA/p Q )] (2) 

The difference A ^CD in P nase values for the points C and D, 
observed by the same detector , can be related to the 
geometric distance AC as follows: 

AC = (p Q / 2* )• A4 CD (3) 

AC is related to the surface height BD as follows: 

BD = AC tan e Q / (1 + tan e Q / tan e n ) (4) 

where the angles e Q and e n are as shown in Fig. 3. 
Assuming that is nearly 90* , as is the case for any 
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practical system with a large demagnif ication factor, the 
relationship (4) can be simplified to: 

BD = AC tan 9 Q (5) 

From Eqs. (3) and (5), the effective wavelength of the 
system is defined as X c = Pq tan e 0 

To measure the phase of the intensity variation 
represented by either Eq. (1) of Eq. (2), the projected 
pattern can be phase modulated by rotating the polarizer P 
(Fig. 2). in the case of Eq. (1), let 



♦ R - 2tf OC/p Q = 2* m + <J>' 



(6) 



where (J)^ is the phase angle reduced to the range 0-2* and 
m is an integer. if ^ represents the phase modulation, 
then from Eq. (1), 

*c " a (*,y) + b(x,y) cos (4> M + ( 7) 

N measurements I x , l 2 Q f I c are made with a phase 

increment of 2?r/N following each measurement. From these 
measurements, one obtains 

tan p R B £ i n 3 in(2* n/N)/£l n cos(2n n/N) ( 8 ) 

[See J.H. Bruning, D.R. Herriott, J.E. Gallagher, D.P. 
Rosenfeld, A.D. White and D.J. Brangaccio, Appl . Opt. 13, 
2693 (1974).] By recording N frames of intensity data, the 
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phase seen by each detector in the array can be computed, 
both for the reference plane and the object surface. Based 
on the continuity of the phase function, starting from a 
reference location with zero phase, the integer m of Eq. (6) 
can also be determined by monitoring the computed phases 
between two adjacent detectors and identifying sharp phase 
discontinuities which result from the 2iC transitions . Eqs . 
(3) and (5) can then be used to compute the surface profile, 
as is further described below. 

Referring to Fig. 4, there is shown a flow diagram of a 
routine for programming the processor 150 of Fig. 1 in 
accordance with a form of the described first embodiment. 
The block 411 represents the setting of the initial phase of 
the incident beam of sinusoidally varying intensity; e.g., 
for example, to a reference phase designated as zero 
degrees. A frame of data (intensity information) is then 
collected and stored from the detector array to get a first 
set of intensity values for the object designated as I Ql 
(x,y) values. A determination is then made (diamond 413) as 
to whether or not the last frame of the sequence has been 
collected and stored. If not, the block 414 is entered, 
this block representing the shifting of the phase of the 
incident beam, such as by rotating the polarizer (Fig. 2). 
In the present embodiment, three frames are used in the 
sequence, so there are two phase shifts of 120 degrees each. 
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It will be understood that the phase shifting can be 
implemented automatically under computer control, semi- 
automatically. or manually, as desired. Accordingly, at the 
completion of the loop 415. three frames of intensity values 
for the object, l on (x,y) are obtained, as follows: 

1 01 = a + b cos (<fc m + ^ (x,y)) 

1 02 = a + b cos (4> m + tf Q ( x , y ) + 2x/3) 

1 03 = a + b cos ($ m + 4>' Q ( x ,y) + 4ir/3) 

The procedure of loop 415 is then repeated for the 
reference plane, as represented by the block 420. This data 
can be obtained, for example, by placing a white reflective 
reference plane adjacent the object, as illustrated in Fig. 
3, and following the procedure just described to obtain 
frames of reference intensity values l rn ( x ,y) as follows: 

I rl = a + b cos (<(> m + 0 £ (x,y)) 

I r2 = a + b cos (<* m + o£ (x.y) + 2K/3) 

I r3 = a + b cos (<|> m + o' r (x.y) + 4ir/3) 

It will be understood that the data could alternatively be 
taken in any desired sequence, such as by interposing the 
reference plane before each phase shift so as to obtain both 
the object and reference intensity information at each 
incident beam phase, although this is not preferred. Also, 
it will be understood that the reference phase information 



BNSDOCIO: <EP 0182469A1J_> 



0182469 



- 18 - 



can be computed without taking measured reference data (from 
the known characteristics of the incident beam and the known 
system geometry), but it is preferable, when possible, to 
obtain the reference data from an actual reference plane so 
as to minimize the effects of distortions in the system, 
etc. 

Next, for a point (x,y) the reference plane phase 
♦{-(x,y) at the point can be computed, using (8) above, from 
the three reference plane intensities as: 



a 

is. % Il rn sin(2*n/3) 
$ r (x,y) = tan A ± 



£I rn cos(27Tn/3) 

as represented by the block 431. The block 432 is then 
entered, this block representing the computation, for point 
(x,y) of the object phase from the three object intensity 



measurements as: 



Vo^'y* m tan i — 

* I on cos(2*n/3) 



A determination is made as to whether or not the last point 
has been processed (diamond 433), and, if not, the processor 
increments to the next point (block 434), and the loop 435 
continues until the reference and object phases have been 
computed for all desired points (x,y). 
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The block 441 is then entered. This block represents 
the procedure of assigning, for each point (x,y) the 
appropriate integer m (see equation (6)) by tracing the 
number of fringes on the reference plane image, where m is 
the fringe number, and then the determination of the 
reference plane phase for each such point. The block 442 
represents the same operation for each point of the object. 
Fig- 12 is a flow diagram of a routine as represented by the 
blocks 441 and 442 for tracing the deformed grating fringes 
in order to assign appropriate ra integer values, so that the 
object and reference phases $ Q (x,y) and <f r (x,y), 
respectively, can be obtained from <J>£ (x,y) and (x,y). A 
y coordinate index is initialized (block 1211), m is 
initialized at zero (block 1212), and the x index is also 
intialized (block 1213). Processing then proceeds on a 
line-by-line basis along the x direction. For a given line, 
at each point, the previously computed phase value (for the 
object phase or the reference plane phase, depending on 
which one is being processed), the phase at each point is 
compared to the phase at the previous point, as represented 
by the diamond 1220- The adjacent phase values are compared 
by determining when there is a transition over a 2 n value, 
and the sign of the transition is also noted. The sign will 
depend on the slope of the object profile. Blocks 1221 and 
1222, as the case may be, are then utilized to decrement or 
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increment, ra, depending upon the sign of the transition, and 
the block 1225 is then entered. Also, if there was no 
transition at the point being examined, the block 1225 is 
entered directly. The block 1225 then represents the 
computation of the reference plane or object phase value (as 
the case may) in accordance with relationship (6). The x 
index is then tested (diamond 1230) and incremented (block 
1231), and the loop 1232 continues for processing of an 
entire line in the x direction on the detector array. When 
the line is complete, the y index is tested (diamond 1240) 
and incremented (block 1241) and the loop 1233 is continued 
until all lines of points have been processed. 

Referring again to Fig. 4, the block 451 represents the 
selection of the first point (x,y) for height computation. 
For the particular point (x,y), the phase difference between 
the object and reference planes is computed in accordance 
with: 

A$(x,y) = $ 0 (x,y) - <f> r (x,y) 

as represented by the block 452. The distance AC (Fig. 3) 
can then be computed (block 453) from 



AC = P^' 



A*(x,y) 



2rr 
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Next, the block 454 represents the conversion into height 
BD, which is defined as h(x,y) in accordance with equation 
(5) as 



h(x,y) = BD = ACtane Q 



It can be noted that suitable calibration factor and 
geometric correction can also be applied to h(x,y). h(x,y) 
can then be stored for display or other use, as represented 
by the block 456. Inquiry is then made (diamond 457) as to 
whether or not the last point has been processed and, if 
not, the point being processed is incremented (block 458) 
and the loop 459 continues as the height values h(x,y) are 
obtained and stored for each point. 

Profile measurements were made, using the system of 
Figs. 1,2, on a general test object (a half cylinder with 
two sections having different radii), mounted on a reference 
plane and illuminated with a sinusoidally varying beam 
intensity as previously described. in order to generate a 
phase variation in both the horizontal as well as vertical 
directions, an inclined set of fringes were projected on the 
object. Fig. 5 shows the deformed grating as seen by the 
detector array. Three images each were recorded for the 
reference plane and the object surface, with a phase 
increment of 120° of the projected fringe pattern following 
each recording, and processing was performed as previously 
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described. Fig. 6 shows part of the surface profile plot, 
which was generated by displaying h(x,y) using a graphics 
plotter. The two sections of the object with different radii 
and the transition region are seen. The values obtained 
were very close to those measured using a contact 
profilimeter . 

In the embodiment of Fig. 7, the collimated laser 
illumination is replaced by the projected image of a 
translatable white light illuminated sinusoidal transmission 
grating. This system requires generally less expensive 
hardware than the previously described embodiment, and is 
more capable of handling large objects. The analysis of 
this system, because of the divergent nature of the 
illumination and because the optical axes of the projection 
and imaging systems are not necessarily parallel, is 
somewhat more complicated. In the Fig. 7 arrangement it is 
assumed that a buffer, processor, display and projection and 
imaging lenses are provided, as in the previous embodiment. 
The optical geometry of the projection and recording systems, 
is represented in Fig. 7. P x and P 2 are the centers of the 
entrance and exit pupils of the projection optics. l x and 
I 2 are the centers of the exit and entrance pupils of the 
imaging optics. G is a grating with pitch p and a 
sinusoidal intensity transmission. D c is one element of the 
image sensing array. The intensity variation along x on 
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the reference plane can be described by the equation: 

I « a(x,y) + b(x,y) cos <j>(x) (9) 

where a(x,y) is the background or DC light level and b(x,y) 
is the fringe contrast. The phase $ in this case is a non 
linear function of x because of the divergent nature of the 
image forming rays. With respect to a reference point such 
as O, every point on the reference plane is characterized by 
a unique phase value- For example, the point C, observed by 
the detector D of the array, has 

<f c = 2*m + # c (10) 

where m is an integer and 0 < 4 C < 2tt • 

The detector array samples the reference plane (as well 
as the object) and is again used to measure the phase at the 
sampling points by a phase shifting technique . As before, 
N frames of intensity data, with N > 2, are recorded and 
after each frame the grating G is translated by a distance 

p Q /N . If Iji I 2 # I N are the intensity measurements 

for a point such as C, then, as previously described 

M 

Il n sin(2Jrn/N) 
tan<|£ = (11) 

£I n cos(2nn/N) 

As the phase function is continuous, it is possible, as 
previously described, to determine m in equation (10) by 
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detecting sharp phase changes of nearly 2n which occur 
between two neighboring sample points, whenever a complete 
grating period has been sampled. 

A particular detector such as D c can measure the phase 
<<» c at a point C on the reference plane as well as * D on the 
point D of the object. A mapping procedure is then used to 
determine a point A on the reference plane such that 
4a = *d • This enables a computation of the geometric 
distance AC. c is a known detector location and the 
position of A, which in general would lie between two 
sampling points, can be located by linear interpolation 
using known phase values. Prom similar triangles P 2 DI 2 and 
ADC, the object height is 



h(x.y) = (AC/d)j{ 0 ' (1 + AC/d)" 1 



(12) 



where d and < Q are distances as shown in Fig. 7. As in most 
practical situations d >> AC because of the large 
magnifications involved, equation (12) can be simplified: 

Mx.y) = (AC/d)jf Q 

It can be noted that h(x,y) is the object height at the x 
coordinate corresponding to B and not C. From known system 
geometrical parameters, one can calculate the distance BC 
and thus determine the x coordinate corresponding to the 
point B. 
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In the routine of Fig, 8, the block 810 represents the 
collecting and storing of three frames of reference plane 
and object data in a manner similar to that previously 
described in conjunction with the loop 415 of Fig. 4. m 
this case, however, in the context of the system of Fig. 7, 
the phase shifting will be implemented by translation of the 
grating G. In this case, the three arrays of object 
intensity values can be represented as 

I ol = a' (x,y) + b' (x,y)cos<(> 0 (x,y) 

z o2 588 a ' (**Y> + D ' (x,y)cos($ 0 (x,y) + 2r/3) 

I o3 - a' (x,y) + b' (x,y)cos(<f> 0 (x,y) + 4T/3) 

and the three arrays of reference plane intensity values can 
be represented as 

I rl = a' (x,y) + b' (x,y)cos4> r (x,y) 

I r2 = a' (x,y) + b' (x,y)cos(<J> r (x,y) + 2*/3) 

I r3 - a' (x,y) + b' (x,y)cos(<J> r (x,y) + 4*73) 

For a point (x,y), the object phase ^ is then computed from 

3 

. At * y ^I on sin(2irn/3) 
tan$ 0 (x,y) = - = 

fl on co8(2rn/3) 

and the reference phase O r is computed in accordance with 

j. / , t ^I rn s in(27rn/3) 
tan(fr r (x,y) = - 

£I rn cos(2irn/3) 
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These functions are represented by the blocks 831 and 832, 
and are consistent with the equation (11) above. The loop 
835 then continues, in similar manner to that previously 
described in conjunction with Fig- 4, to obtain the 
reference and object phases for all desired points (x,y), 
diamond 833 and block 834 being used in the loop in the 
manner previously set forth. 

Next, as represented by the block 841, for each point 
(x,y), the appropriate integer m (see equation (10)) is 
obtained by tracing the number of fringes on the reference 
plane image, where m is the fringe number, and the reference 
plane phase for each such point is then determined. The 
block 842 represents the same operation for each point of 
the object. Reference can again be made to Fig. 12, and the 
accompanying description above, for the manner in which the 
resultant phases + r (x,y) and <J> Q (x,y) are obtained. 

Fig. 8B includes the phase mapping portion of the 
routine. A first point is selected for phase mapping, as 
represented by the block 851. For the point D on the 
object, the phase $ Q (x,y) is compared to the phases of the 
sampling points on the reference plane, so as to locate 
point A on the reference plane which has the same phase. 
The geometric distance AC, between the points having the 
same phase, is then determined in terras of detector element 
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spacings (block 853). The object height can then be 
computed (equation (12)) ass 

h(x,y) = (AC/d)i 0 (1 + AC/d) -1 

as represented by the block 854. Alternatively, as 
described above, equation (13) could be used in some 
situations. Again, suitable calibration factor and 
geometric correction can then be applied, and the height 
h(x.y) is stored, as represented by block 856. Inquiry is 
then made (diamond 857) as to whether or not the last point 
has been processed. if not, the point to be processed is 
incremented (block 858). and the loop 859 is continued to 
completion. 

For experimental measurements, sinusoidal gratings were 
generated by photographing out of focus a square wave 
grating pattern. A conventional slide projector was 
modified in order to operate with a grating slide, mounted 
on a stepper motor driven translation stage. The period of 
the projected grating measured on the reference plane, close 
to the optical axis of projection, was about 15 mm. 
Deformed grating images were recorded on a 128 X 128 
photodiode array detector. Phase measurement was by a three 
discrete phase shift implementation of equation (11), and 
processing was in accordance with the routine previously 
described. 
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The results of a calibration experiment, using a 
cylindrical test object, which had been measured by a 
mechanical contact prof ilometer , are shown in Fig. 9. The 
line profile was generated using the experimental optical 
system and the 'X* marks indicate measurements made by a 
manual contact prof ilometer . An agreement of better than 1% 
between the measurements was observed, except in the regions 
with steep slopes where mechanical contact methods are not 
very reliable. 

A more general type of diffuse object, a mannequin 
face, was also measured. Fig. 10 shows the deformed grating 
produced by this object. Fig. 11 is a graphical 
representation of the results obtained with the optical 
system and shows 97 profile lines with 87 points on each 
line. This object was approximately 150 mm wide and the 
depth at the tip of the nose measured from a reference plane 
was about 100 mm. in order to obtain a complete shadow free 
illumination of such objects and obtain a large angular 
field of view, two or more projected gratings may be used. 

In accordance with an embodiment of a further form of 
the present invention, a complete 360 degree view, or a 
desired portion thereof, of a three-dimensional object, is 
obtained with minimal complication and processing. Consider 
the arrangement of Fig. 13 which, like Fig. 7, employs a 
projected image of a translatable white light illuminated 



BNSDOCID: <EP 01 82469 A1 _l_> 



0182469 

- 29 - 

translatable grating, G. In this case the projection and 
imaging optics are respectively represented in the Figure by 
lenses 1301 and 1302. A linear detector array 1350, for 
example a photodiode array, is provided. A three- 
dimensional object 1310, a mannequin head in the 
illustration, is mounted on rotatable table 1315 which is 
driven in rotation increments using motor 1320 which, in the 
present embodiment, is under control of a processor (to be 
described) . it will be understood that the relative 
rotation as between the optical system and the object can be 
implemented by any suitable means and, if desired, the 
optical system can even be rotated around the object, 
although this is usually less preferred. The sinusoidal 
grating is projected onto the object and the resulting 
deformed grating is reimaged onto the linear detector array 
1350. The distance h, which in this case is the distance of 
an object point D from a reference line, when determined for 
each vertical (y) position, gives the object profile in the 
slice defined by the Y-Z plane. This is a "line profile of 
the object surface at the slice taken at a rotational angle 
e (Fig. 13b). As the object is rotated around the Y-axis in 
incremental steps, every h-value obtained corresponds to the 
radial distance A r of a general point P from a reference 
virtual cylinder of radius R, as shown in Fig. 13b. 
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The complete 3-D object data can be obtained through a 
360 degree rotation of the object, and can be expressed in 
terras of Ar(Y,0) in cylindrical coordinates. If desired, a 
general object point P can be represented in relation to a 
global system of coordinates X, Y, Z using the 
trans formation 

X = R sin(8) C 1 -Ar/R] (14) 
Z = R cos(e) C 1 - Ar/R] (15) 

The values of A r , for a given line profile 
corresponding to a B value, are obtained using the following 
procedure: Three frames of line intensity data, I 1# i 2 , and 
I 3 are recorded for three grating positions phase-shifted by 
2*/3. Three frames of line intensity data are also 
determined for the reference line. [This only need be done 
once, since the reference line is the same for all profiles. 
Again, the reference data can be computed without direct 
measurement, if desired.] Next,A r (or h) is determined by 
using a phase-mapping technique, as was described above. A 
particular detector in the linear array 1350 measures the 
phase e c at point C on the reference line as well as Phase 
6 D at the corresponding point D on the object. A mapping 
procedure can then be used to determine a point A on the 
reference line such that 6 C = © D , enabling the computation 
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of the geometric distance AC in terms of detector spacings. 
AR or h is determined from relationship (12) above, i.e. 

Ar = h = (AC/d)X 0 (1 - AC/df* 

where distances d and 8. Q are as shown in Fig. 13a. Once 
again, if AC/d << 1, then 

Ar . (AC/d)^ Q (equation 13) 

The object is then stepped to the next rotational angle, e, 
and the next line profile is obtained. it will be 
understood that the data can all be obtained before line 
profiles are computed or, alternatively, line profile 
computations can be made between taking data or 
contemporaneous therewith. As a further alternative, the 
data for each line profile can be taken for a first phase of 
the incident beam, and then the grating shifted and the data 
again taken for the second and then the third phases of the 
incident beam. if desired or advantageous for storing or 
plotting the three dimensional object, the A r values can be 
inserted into equations (14) and (15) to obtain the 
governing equations for a general point description as 
follows : 

X = sin(e) (R - AO< 0 /d) (16) 
Z - cos(9) (R - AC» / 0 /d) (17) 
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These expressions represent the 'wrapping 1 of the data to 
obtain the final 3-D shape with reference to a global X, Y, 
Z, coordinate system. The geometrical parameters of 
equations (16) and (17) can be obtained or verified through 
precalibration experiments. 

Fig. 14 shows a block diagram of an embodiment of an 
apparatus in accordance with the invention. A sinusoidal 
grating projection system and phase shifter 1410 is 
provided, and projects an optical beam at a three 
dimensional object 1450, which is mounted on rotary stage 
1490. The grating projector and phase shifter 1410 includes 
a source of white light illumination, a movable sinusoidal 
grating (e.g. G of Fig. 13a) and a projection optical (e.g. 
1301 of Fig. 13a). The rotary stage 1490 may comprise a 
rotatable table 1315 and processor-controlled motor 1320, as 
shown in Fig. 13a. A linear camera array 1420 includes 
imaging optics (e.g. 1302 in Fig. 13a) and a linear detector 
array (e.g. 1350-m of Fig. 13a). The linear detector array 
may alternately be implemented by scanning one line of a two 
dimensional array. Information from camera 1420 is 
digitized by analog-to-digital converter 1460, and the 
resultant digital signals are coupled to processor 1470. 
Again, the processor may be for example any suitable digital 
or analog (in which case no A/D would be required) computer, 
processor, or microprocessor and associated memory and 
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peripherals, programmed consistent with the teachings 
hereof, a Digital Equipment Corp. Model LSIll/23 having been 
employed in one implementation. The processed information 
can be displayed on a display device 1480. 

Referring to Fig. 15, there is shown a flow diagram of 
the routine for the processor 1470 of the Fig. 13 
embodiment, utilized to obtain data from which line profiles 
of an object are generated. The block 1511 represents the 
initiation of the system at an initial rotation angle, 6. 
The block 1512 is then entered, this block representing the 
collection and storage of three lines of object data for the 
current line profile (or slice), at rotation position 0. 
This is done, for example, by storing the intensity value 
obtained at each detector element of the linear detector, 
shifting the grating G to obtain a phase shift of 2tT/3, 
whereupon another line of data is taken at the detector 
elements and stored; followed by another phase shift of 2n/3, 

and collection and storage of data. After the data for 
the current line profile is collected, inquiry is made 
(diamond 1513) as to whether or not the last angle 9 has 
been processed; i.e., whether or not a full 360 degrees of 
rotation increments has been implemented, in the present 
example. If not, rotation to the next increment is 
implemented (block 1514), and the loop 1520 is continued, as 
a full set of data is obtained and stored. 
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A reference plane can then be interposed (e.g., 
automatically or manually) and the collection and storage of 
three lines of reference data, for the three different 
reference phases, is obtained and stored in the same manner, 
as represented by the block 1513. Since the reference plane 
(which, when detected by the linear detector array, can be 
considered as a reference line) does not change, this data 
is taken only once. In the present embodiment, the object 
data is taken and stored continuously, although it will be 
understood that processing can be implemented, if desired, 
during the data acquisition mode; for example, by processing 
each line profile after the data is taken for said line 
profile (either before the data is taken for the next line 
profile, or contemporaneously therewith, such as on a time- 
sharing basis). Also, as previously indicated, a full set 
of data can be taken at a first phase of the incident beam, 
followed by repeats at second and third phases of the 
incident beam. 

Referring to Fig. 16, there is shown a flow diagram of 
the routine for obtaining the object phase ^(y,9) and the 
reference phase ^(y ( 9) for each point y of each line 
profile (at reference angle 9), from the data taken in the 
routine of Fig. 14. The block 1511 represents the 
initialization to the first line profile (at initial angle 
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8, and the first point, y) . The object phase $ ' Q is then 
computed, using the relationship of equation (11), as: 



±t . ^ I r>n sin2ltn / 3 



Inquiry is then made (diamond 1513) as to whether or not the 
last point, y, of the current line profile has been 
processed. if not, the point index is incremented (block 
1514) to the next point y of the current line profile, and 
the loop 1520 is continued until all values of (> Q (y,e) for 
the current line profile are obtained. When the inquiry of 
diamond 1513 is answered in the affirmative, the diamond 
1531 is entered, and inquiry is made as to whether or not 
the last line profile has been processed. If not, the 
rotation angle index 0 is incremented (block 1532), and the 
phases are obtained for each point y for the next line 
profile reference angle 9 (via loop 1520), and the loop 1540 
continues until all of the phase values <^(y,e) have been 
obtained. 

Next, a similar routine is utilized to obtain the 
reference phase angles ^(y) for the points y on the 
reference line, as follows: The reference point index is 
initialized to the first point y (block 1551), and the 
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reference phase ^(y) is obtained using the relationship: 



tan 



Z I rn sin2*n/3 

-1 1 

£ I rn cos2irn/3 



as represented by the block 1552. The loop 1560 then 
continues, in a manner similar to that just described with 
respect to the object phase computations, with the point 
index y being incremented (block 1554) and the loop 
continuing until the inquiry of diamond 1553 indicates that 
the reference phases have been obtained for all points y of 
the reference line. 

It will be recalled that the values represent the 
component of the phase $ that is between 0 and 2Tt (e.g. 
equation (10) above), and that $ can be obtained from 

<J = 27Tm + 

where it can be determined, as previously described, by 
detecting sharp phase changes of nearly 27t which occur 
between two neighboring sample points, whenever a complete 
grating period has been sampled. 

In the diagram of Fig. 17, the block 1711 represents 
the determination of the $Q(y,8) values from the previously 
obtained values of ty 0 (y.Q) by obtaining a value of m for 
each point, using the routine of Fig. 12. The block 1712 
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represents the same operation, but in this case the values 
4> r (y) are obtained for each point y of the reference line; 
again, by assigning values of small m by tracing fringes, 
using the routine of Fig. 12. The block 1713 represents the 
use of a mapping routine (of the type shown in Fig. SB) to 
determine the geometric distance AC in terms of detector 
spacings. The value Ar(y,e) for each point is then 
obtained, in accordance with the relationship set forth 
above as 



-V 



Ar = (AC/d)je o (l-AC/d) 

as represented by the block 1714. Having obtained the 
contour profiles in cylindrical coordinates, the 
relationships (14) and (15) can then be used to obtain the 
three dimensional surface profile of the object in 
rectangular coordinates, as represented by block 1715. 

In an experimental system, a 128 by 128 photodiode 
array was employed and a single column of data was read out 
and then processed as previously described. a mannequin 
head was again chosen as a test object. The projected 
grating pitch on the object was 15 mm and the angle between 
the projection and imaging axes-- = 20-degrees, resulting in 
an equivalent system wavelength of 45 mm. The object was 
rotated through 360-degrees in step increments of 2-degrees, 
resulting in a total of 128X180 sampling points. The final 
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results were displayed on a graphics monitor and recorded on 
a high-resolution plotter. Fig. 18 shows the 180 line 
profiles that were obtained for the mannequin head, directly 
from the raw data. Fig. 19 shows the same information, but 
with the lines presented in the 0 direction. The "wrapping" , 
obtained by the transformation indicated in equations (14) 
and (15) leads to the reconstruction of the actual 3-D shape 
in the global rectangular coordinates. Pictorial 
representation from different perspective are shown in Figs. 
20, 21, 22 and 23. In these pictures, every other data line 
in the Y direction has been plotted. With the available 3D 
data it is also possible to fit mathematical surfaces for 
the entire 360-degree object, and using computer graphics 
techniques, solid shaded surface displays can be created. 

The invention has been described with reference to 
particular preferred embodiments, but variations within the 
spirit and scope of the invention will occur to those 
skilled in the art. For example, various alternative types 
of projection and detector systems can be used, consistent 
with the principles of the invention. Also, if desired, 
laser illumination can be used (e.g., in Fig. 2) to obtain 
line profiles and phase difference between computed object 
and reference phases can be used to compute distance for 
each point on a profile. 
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1. A method for determining the surface profile of an 
5 object, comprising directing a light pattern on to a 

surface and using the deformed light pattern at the 
surface to determine the required profile, characterised 
by: 

directing (110) at the object (150) an incident beam 
10 of light having a sinusoidally varying intensity pattern; 

modulating the phase of the sinusoidal intensity 
pattern of the incident beam; 

receiving at a detector (120) a deformed grating 
image of the object for a number of different modulated 
15 phases of the incident beam; 

determining (150) , for points on the surface of the 
object, the height at each point with respect to a 
reference plane, each height determination including the 
step of combining the image intensity values at a 
20 detector position corresponding to a respective point of 
the object. 

2. A method as defined by claim 1, wherein the 
intensity values at each detector pixel position are 
combined to determine an object phase at a corresponding 

25 object point, and wherein the difference between the 
object phase at each such point and a reference phase at 
a corresponding point on the reference plane is used to 
determine the object height at such point, 

3. A method as defined by claim 2, wherein the 
30 reference phases are obtained by positioning a reference 

plane in the vicinity of the object position, and 
determining, for points on the reference plane, detector 
intensity values for the different modulated phases of 
the incident beam, the intensity values for each point 

35 
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being combined to obtain a reference phase for such 
point. 

4. A method as defined by claim 1, wherein reference 
phases are obtained by positioning a reference plane in 
the vicinity of the object position, and determining, for 
points on the reference plane, detector intensity values 
for the different modulated phases of the incident beam, 
the intensity values for each point being combined to 
obtain a reference phase for such point; and wherein the 
step of determining height includes determining the 
distance between positions on the detector at which a 
reference phase corresponds to an object phase, 

5. A method according to claim 1 or 2, in which the 
step of determining the height of each point on the 
object surface with respect to a reference plane 
comprises storing the deformed grating image of the 
object for a number of different modulated phases of the 
incident beam; 

receiving and storing an image of a reference plane 
for the same number of different modulated phases of the 
incident beam; 

combining image intensity values at each point of 
the deformed grating image of the object to obtain an 
object phase at each such point; 

combining image intensity values at each point of 
the image of the reference plane to obtain a reference 
plane phase at each such point; and 

determining the object height at each point from the 
object phase and reference plane phase for each such 
point. 

6. A method of determining a three-dimensional surface 
profile of an object, comprising the steps of: 

a) directing (1410) at the object an incident 
beam of light having a sinusoidally varying intensity 
pattern; 
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b) modulating (1410) the phase of the sinusoidal 
intensity pattern of the incident beam; 

c) receiving and storing (14 70) a deformed grating 
image of a line profile of the object surface for a 

5 number of different modulated phases of the incident 
beam; 

d) determining (1470), for points on the line 
profile of the object surface, the distance of each such 
object point from a reference line, each such distance 

10 determination including the step of combining intensity 
values of the received image at the different modulated 
phases; and 

e) rotating (1490) the object by an angular 
increment at a time, and repeating steps (a) to (d) for 

15 each increment to obtain line profile distances for each 
such increment . 

7. A method as defined by claim 6, wherein the deformed 
grating image is received at a linear array of detectors, 
and wherein the step of combining intensity values of the 

20 received image at different modulated phases comprises 
combining the intensity values at individual ones of the 
detectors. 

8. A method as defined by claim 7, wherein received 
image intensity values at individual detectors are 

25 combined to determine an object phase at a corresponding 
object point, and wherein the difference between the 
object phase at each such point and . a reference phase at 
a corresponding point on the reference line is used to 
determine the distance of the object point from the 

30 reference line. 

9. A method as defined by claim 8, wherein the 
reference phases are obtained by positioning a reference 



35 
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different modulated phases of the incident beam, the 
intensity values at individual ones of the detectors 
being combined to obtain a reference phase for a 
corresponding point on the reference line. 
5 10. A method as defined by claim 8 or 9 , wherein the 
determination of the distance of each object point from 
the reference line includes determining the distance 
between detectors at which a reference phase corresponds 
to an object phase. 

10 11. A method as defined by any of claims 6 6o 9, wherein 
the receiving and storing of step (c) is performed for 
all of the different angular increments of step (e) 
followed by the distance determinations of step (d) . 
12. A method as defined by claim 11, wherein the 

15 receiving and storing of step (c) is performed for one 
phase of sinusoidal intensity pattern of the incident 
beam for each increment, and then repeated for each of 
the other phases of sinusoidal intensity pattern of the 
incident beam. 

20 13. A method as defined by anyone of claims 6 to 12 , 
wherein the step of rotating the object by an angular 
increment at a time and repeating steps (a) to (d) for 
each increment to obtain line profile distances for each 
such increment, comprises rotating the object through 

25 substantially 360 degrees of angular increments to obtain 
a complete three-dimensional profile of the object. 
14. Apparatus for determining the surface profile of an 
object, comprising: 

means (110) for directing at the object (150) an 

30 incident beam of light having a sinusoidally varying 
intensity pattern; 

means (110) for modulating the phase of the 
sinusoidal intensity pattern of the incident beam; 

35 
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a detector (120) for receiving a deformed grating 
image of the object for a number of different modulated 
phases of the incident beam; and 

means (150) operative to combine the image intensity 
5 values at a detector position corresponding to a 
respective point of the object, for determining, for 
points on the surface of the object, the height at each 
point with respect to a reference plane. 

15. Apparatus as defined by claim 14, wherein the 
10 determining means (150) is operative to combine intensity 

values at each detector pixel position to determine an 
object phase at a corresponding object point, and is 
operative to obtain the difference between the object 
phase at each such point and a reference phase at a 
corresponding point on the reference plane to determine 
the object height at such point. 

16. Apparatus for determining a three-dimensional 
surface profile of an object, comprising: 

means (1410) for directing at the object an incident 
beam of light having a sinusoidally varying intensity 
pattern; 

means (1410) for modulating the phase of the 
sinusoidal intensity pattern of the incident beam; 

a detector array (1420) for receiving a deformed 
25 grating image of a line profile of the object; 

means (1470) for storing the deformed grating images 
received at the detector array for different modulated 
phases of the incident beam; 

means (149 0) for implementing rotational increments 
of the object (1450) with respect to the incident beam 
and the detector array (1420) so that the detector array 
receives deformed grating images of different line 
profiles of the object; and 

means (1470) for determining, for object points on 
such line profiles of the surface of the object, the 
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30 
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distance at each such object point with respect to a 
reference line, the said distance-determining means 
including means operative to combine the stored image 
intensity values at a particular detector of the detector 
5 array corresponding to a respective point of the object. 
17, Apparatus as defined by claim 15 , further comprising 
means responsive to the outputs of the detector array for 
storing deformed grating images of a reference line for a 
number of different modulated phases of the incident 
10 beam. 
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